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Abstract 



Empirical Bayes estimators for the scale parameter in a Weibull, 
Raleigh or an exponential distribution with type II censored data are 
developed. These estimators are derived by the matching moment 
method, the maximum likelihood method and by modifying the 
geometric mean estimators developed by Dey and Kuo (1991). The 
empirical Bayes risks for these estimators and the Bayes rules are 
evaluated by extensive simulation. Often, the moment empirical Bayes 
estimator has the smallest empirical Bayes risk. The cases that the 
modified geometric mean estimator has the smallest empirical Bayes 
risk are also identified. We also obtain the risk comparisons for various 
empirical Bayes estimators when one of the parameters in the 
hyperprior is known. 
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1. INTRODUCTION 

. In reliability analysis, we often conduct similar tests to assess the 
reliability parameters. Empirical Bayes (EB) estimators may be employed to 
reduce the risk by combining all the test data. There are usually several 
reasonable empirical Bayes estimators. As pointed out by Martz and Waller 
(1982, p. 633), it is an important question which EB estimator has the smallest 
EB risk (the expected Bayes risk of the EB rule). We report here some Monte 
Carlo results that estimate the EB risks. These results will guide us in 
determining which EB estimator is more desirable. 

We assume that we are simultaneously testing p populations. For the 
population, i = 1, ..., p, we test rii devices until r, of them fail. The lifetime for 
each device tested in the population is assumed to be Weibull with known 
shape parameter p,- and unknown scale parameter A,-, 

_i!L 

( 11 ) 

A,- 

This model includes the exponential (p,- =1) and Raleigh (p,- = 2) distributions. 
Let ti = {til — / Ur) denote the ordered lifetimes of the r,- devices that failed 

in the population, where tn < ..., < f,>.. Then S,- = («j 

sufficient statistic for A,- with gamma distribution G(r,-,A,). 

In this paper, we consider a parametric empirical Bayes formulation. We 
assume the parameters A; are independent and identically distributed with 
the inverted gamma distribution IG{a, /3). This conjugate prior is chosen to 
facilitate a closed form expression for the Bayes estimator A,-. To obtain 
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empirical Bayes estimators, we are going to estimate a and J3 from the 
marginal density of S,- given a and j3. We then substitute these estimates d 
and P for the a and j9 in the Bayes rule. Usually, we can estimate a and by a 
moment method or by an ML-II method. The moment method estimates a 
and p by equating functions of a and p to the marginal mean and the 
marginal variance respectively. The ML-II method obtains the maximum 
likelihood estimates of a and P from the joint density of Sj, Sz, ..., given a 
and p. Recently, Dey and Kuo (1991) have obtained a different EB estimator 
when a is known. This estimator expands the usual estimator by a multiple 
of the geometric mean of the component estimators. They show the 
geometric mean estimator dominates the best multiple estimator (in 
frequentists' risk) for a wide class of p, a, and r,- values. In this paper, we 
propose a modified estimator called the hybrid geometric mean estimator 
which estimates a by the moment method and estimates P as in Dey and Kuo. 

We compare the EB risks of the three EB estimators: moment EB, ML-II 
EB and hybrid geometric mean EB. The EB risks cannot be expressed in closed 
form. We employ extensive Monte Carlo simulations to approximate these 
EB risks. Our simulation results show that all the three EB estimators 
perform well when compared to the Bayes estimator for a>5, P> 5, ri > 5, for 
all I and p>5. 

If we fix the number of censored devices, say for example, r,- = 2 for all i, 
our recommendation depends on the different a and P values. A more 
detailed discussion is given in Section 3. In general, it is safe to recommend 
the moment EB estimator. Unless we are in the situation with moderate a 
and moderate P values (around a = 5 and P = 3), where the hybrid geometric 
mean estimator is recommended. Unfortunately, our recommendation 
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depends on the unknown a and P values. This should not deter us in using 
the recommended estimators, since we do discuss various methods in 
estimating a and P in this paper. 

If the number of censored devices is moderate, say r/ = 5 for all i, then we 
would recommend using the moment EB estimators for any values of a 
and p. 

We have also evaluated the EB risks for two other cases (1) a known and 
(2) P known. In case (1), we compare the EB risks among the Dey and Kuo 
(D/K) estimators, the moment-EB and the ML-II EB estimators. All three 
estimators have comparable risks independent of a, P, ri, and p. In case (2), 
we compare the EB risks between the ML-II and the moment-EB estimators. 
The ML-n EB is clearly a winner in almost all cases, except the cases where 
both r,- and a are small, say around r,- = 2 and a = 2. 

Different classes of EB estimators are developed by Lemon and Krutchkoff 
(1969) and Canavos and Tsokos (1971). Bennett and Martz (1973), Couture and 
Martz (1972) consider nonparametric EB estimation of 1/Ap. Martz and 
Waller (1982) have also provided many relevant developments in this area. 

In Section 2, we derive the various estimators for risk comparisons. In 
Section 3, we discuss the Monte Carlo methods to approximate the EB risk 
and the results. 

2, EB ESTIMATORS 

By sufficiency considerations, observe that the S,- have independent 
gamma distributions G(r,-, A,). We assume that the A,-, i = 1, ..., p, have 
independent inverse gamma distributions IG(a,p), i.e., 

]_ 
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The posterior distribution of A,- given S,- is IGia+ri, f5/(Sip+l)). Therefore, the 
Bayes estimator for A,- with respect to the squared error loss 
= j is 

^b(0 = ^ + - 7 —^ r- (2.1) 

^ a + r;-l p{a + ri-l) ^ ’ 

To construct EB estimators, we first obtain the marginal density of Si, 

= j; (2.2) 

Therefore, we can find a, which maximize the joint density of the Si's, 

(2.3) 



fnl o\ + S/' 

m(^a,p) = TT — — — — ■ — . 



In Appendix 1, we show there is a unique root of 
d d 

— — logm(^a,j3) = 0 = — logm{S\a,p). A sufficient condition based on the 
doc dp 

second derivative test is given to verify that the unique root a,fi yields the 
maximum likelihood estimates of (2.3). 

In addition to the ML-II method we can also estimate a and by the 
moment method. We will assume ri = r for all i. Using the two equations in 
Berger (1985, p. 101) which relate the marginal mean and the marginal 
variance to expectations from the model, we have 






P{a-l) 



, and 



\2 



r^- 



/3(a-l) 



r(«-i) 



,-l)H a-2j' 



Define = ISi I l(Si - fimf / {p ~ ^)- can solve a and from (2.4) 

using to substitute for and o^. We have 
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,2 k and = max-^ 



(«-l)Mm 



—M. (2.5) 



The truncated version is obtained because without the condition a > 2 we 
do not have finite variance in the prior distribution. Moreover, p must be 
positive. The same truncation methods are also applied to other EB 
estimators. 

Next we will discuss how to obtain the hybrid geometric mean EB 
estimator. In Dey and Kuo (1991), they show 
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( 2 . 6 ) 



The Dey and Kuo EB geometric mean estimator is obtained from (2.1) with p 
estimated from (2.6) and known a. However, the assumption of known a is 
too restrictive in practice. In this paper, we propose to estimate a by a 
moment condition. Observe from (2.4), 



Mm ^ r{a-2) 
ai a-l + r' 



(2.7) 



Therefore, we can solve for a from (2.7) using and 6^ for and o^, 
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®ratio “ ^MM • 



( 2 . 8 ) 



The hybrid geometric mean EB estimator is obtained from (2.1) using (2.6) and 
(2.8) to estimate a and p. 

We have considered the EB estimators for a and P unknown. We can 
also develop EB estimators when a is known. In this case, we will consider 
the following EB estimators: (1) the moment EB, where 



from (2.6). 

For the other case p known, we estimate a by (1) the moment 
consideration 



and (2) the maximum likelihood estimate of a from (2.3), i.e., the root of 
equation (A.2) in the appendix. 

We report the EB risk evaluations of these EB estimators in the next 
section. 

3. EB RISKS 

Recall the loss function is defined by 




(2.9) 



(2) the ML-n EB, where P is estimated by maximizing (2.3) as a function P for 
the given known a; and (3) the Dey and Kuo (D/K) EB, where P is estimated 



a = max 






( 2 . 10 ) 



L(i,a) = ii(Aj-ai)^ 

Pi=\ 



J=1 
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The Bayes risk of a decision rule 5(S) = (5i(S),...,5p(S)) is defined by 

r(;r,5(S)) = J j L(X,b{S))f{S\X)dSd7i{X). 

The EB risk of 5(S) is the expected Bayes risk, where the expectation is taken 
over all the samples. 

EBrisk = £r(;r,5(S)). (3.1) 

The EB risk is approximated by the Monte Carlo method. In each 
iteration, we generate A,-, i = 1, ..., p from an IG{a,p) distribution with a,p fixed. 
Given the X/s, we generate X,/, / = 1, ..., 10 from the exponential distribution 
Exp(A,). The random variable tj£ =X^^ is distributed as (1.1). We order the 

variables tn < tn < ..., < tir, and compute S,- = (10-r)f|J 

assume r,- = r and p,- = p for all i.) We compute the Bayes rule Sb as in (2.1). 
We also compute each of the EB rules as in Section 2. Then we repeat these 
steps for 10,000 iterations. The EB risk is approximated by 

A 1 10,000 p 2 

where Xjj is the parameter for the population simulated in the iteration, 
and 5£B,j(i) is the EB estimator for the population in the iteration. 

Figure 1 plots the EB risk of the Bayes estimator (2.1), the ML-II EB (from 
(A.2) and (A.3)), the moment EB (from (2.5)) and the hybrid geometric mean 
EB (from (2.6 and 2.8)) for five populations with r = 2, 5 and 10. It is expected 
as r increases, the EB risk decreases because more information on the 
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Figure 1. EB risks of the four estimators arc plotted versus r (the number of failures observed i 
each population) for a class of configurations when both a and /) are imknown 



lifetimes is collected. Moreover, the differences of the EB risks of the three 
estimators and the Bayes rule also decrease. We observe that the Bayes rule 
has the smallest risk. 

If we fix the number of censored devices, say for example, r,- = 2 for all i, 
our recommendation depends on the different a and values. Case (1): a is 
small, say around 2. The hybrid geometric mean is the best. It is a bit better 
than the moment EB. Both outperform the ML-II EB by a substantial amount. 
Case (2): a is large, say around 10, the moment EB is best. It improves upon 
the ML-II EB by a small amount. Both dominate the hybrid geometric mean 
estimator by a substantial amount. Both cases 1 and 2 are somewhat 
insensitive to the values. Case (3): a is moderate, say around 5. Then the 
performances depend on the P values. When p is small around 1, then the 
moment EB improves the other two by a substantial amount. When p is 
moderate around 3, then the hybrid geometric mean estimator improves 
upon the other two estimators by a substantial amount. In summary, it is safe 
to use the moment EB estimators unless we are in the situation of moderate 
a and p values (around a = 5 and p = 3). 

Next consider the case that number of censored devices is moderate, say r* 
5 for all i. The moment EB consistently performs well among the three 
estimators independent of the values of a and p. 

Figure 2 plots the EB risks of the four estimators for various r values 
when a is known. The four estimators are the Bayes, moment, ML-II and the 
one developed in Dey and Kuo (1991). The latter three estimators are 
computed from (2.1) with p estimated by (2.9), (A.3) and (2.6), respectively. 
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Figure 2. EB risks of the four estimators are plotted versus r for 
configurations when a is known. 



Only the configurations with a = 5 and = 1,3 are plotted here. All the other 
configurations show similar behavior, therefore are omitted. All the results 
show that the Dey and Kuo estimator dominates the moment and ML-II 
estimators, sometimes by a very small amount. 

Figure 3 compares the EB risks of the three estimators for various r 
values, where P is known. The three estimators are the Bayes estimators, the 
moment, and the ML-II estimators. The parameters a in the two latter 
estimators are computed from (2.10) and (A.2), respectively. Our simulation 
results show that the ML-II EB dominates the Moment EB usually. The 
improvement of the ML-II EB over the Moment EB could be substantial in 
many cases. The exception occurs when both r and a are small, where the 
moment EB improves upon the ML-II EB by a small amount. Only two cases 
with a = 5 and = 1,3 are presented here for short. 

All the figures are produced by the GPLOT procedure of the SAS 
(Statistical Analysis System). 
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Figure 3. EB risks of the three estimators are plotted versus r for two 
configurations when p is known. 



APPENDIX. ML-II PRIOR APPROACH TO EB ESTIMATION 



In this appendix, we derive the maximum likelihood estimates of a and p 
from the joint density of the S,'s given in (2.3). 

To maximize (2.3), we can equivalently maximize the following 
logarithmic function of (2.3) 

/K)3) = 21 {in r( a + r/ )- In r(a) + r, • In (a + r,)ln(S,/? + l) + g(ji-,S,)}, (A.l) 
i=l 



where g does not depend on a, p. 

We first obtain the first derivatives of / and set them to 0: 



(A.2) 

(A.3) 



= Z{ + 'j) - Via) - ln{Sfi + 1)} = 0 and 

SiP + l 

where *F(a) = —In r(a) and a + rA = — In r(a + rA 
da da 

A computer program using the bisection method has been written to 
search for the roots of (A.2) and (A.3). 

Next we will verify (by the second derivative test) whether the root (a,P) 
is a local maximum of /. Let us first evaluate the second derivatives. Using 
the recurrence formula for 'Fia+rp as in Abramowitz and Stegun (1964, p. 
258), 

F(a + ri)= + 



rj-l + a Vi -2 + a 



1+a a 



we have 
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da 



^ /w) = -zj; — (^-4) 

M [{ri-l + af {n-2+af f v ; 

V 



-^/(a,^) = X and 

dadfi Sjj3 + 1 



dp‘ 



■/(«-/j) 
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(“■^) ‘ S' 


n . («+n)sf 
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- V 


(a + rj)S,- ^ {d + ri)sf 


“ Zj 

Z=1 


[Sip+i]p 
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=z 






Z = 1 


p{Sip + l) 





(using A. 3) 



(A5) 



Let -^-^f(d,p] denote the 2nd partial derivative with respect to a evalu- 
da"^ '' ' 

ated at (d,p). Similar notations are defined for other derivatives. The second 



derivative test states that if 



D = 



da‘ 






dadp 
d^ 






da' 



■fM 



>0, then 



(a,p) 



and 



is a local 



maximum of f{a,p). Since — jf(d,p) < 0, we need only program the second 

da^ ' ' 

condition and verify it. That is, we need to show 

2 



D = 



p n ^ 

I Ztt 



,=i /=i(a + r, -;) 
the solution to (A.2) and (A.3). 







P {d + ri)Si 
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► >0, where (d,P) is 
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We have discussed how to obtain the maximum likelihood estimates of 
(A.l) when both a and p are unknown. For the case that p is known, we 
maximize f{a,P) by solving {A.l) as a function of a. There is a unique root of 
{A.l) which maximizes f{oc,p) because f{a,p) is a concave function of a as 
shown in (A.4). For the other case that a is known, we solve (A.3) as a 
function of p. This root maximizes (A.l) because of the condition in (A.5). 
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